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Abstract 
We  show  how  a  consistency  condition  for  semi-finite  systems  of 
linear  inequalities  can  be  applied  in  various  contests.   We  conclude 
with  some  speculations  regarding  systems  with  an  infinite  number  of 
variables. 


Ascent  Ray  Theorems  and  Some  Applications 

1.    Introduction  In  Spring  1973  I  took  a  course  on  Convex  Analysis 
taught  by  Bob  Jeroslow.  One  of  the  exercises  assigned  was  "prove  the 
best  result  you  can  about  when  a  semi-infinite  system  of  linear  inequal- 
ities a.x  >_  b .  has  a  solution."  The  natural  conjecture  was 

Theorem  1.1:  Let  a .  6  R  ,  b .  E  R  for  all  i  6  I.   If  there  is  no  x  such 

i     '   l 

that  a.x  >_  b.,  i  £  I  then  there  is  a  w  E   R  such  that,  for  every  N,  there 

is  a  finite  F  €  I  such  that  a.x  >  b.,  i£  F  implies  wx  >  N. 

i  —  i  — 

After  a  week  or  so  I  found  a  proof.  Bob's  reaction  was  "you  should 
write  that  up".  With  his  unselfish  assistance  I  did.  That  was  my  first 
paper  [  2  ]. 

The  proof  of  Theorem  1  in  [  2 ]  was  based  on  the  Kuhn-Fourier  theorem 
[12],  which  deals  with  the  case  in  which  I  is  finite.   I  also  made  use 
of  the  fact,  that,  given  a  fixed  basis  for  a  vector  space,  there  is  a 
bound  on  the  size  of  coefficients  used  to  represent  any  vector  of  unit 
length  in  terms  of  the  basis.  Today,  I  would  not  dismiss  this  result 
as  "...a  trivial  exercise  in  linear  algebra...."*  Otherwise,  I  would 
use  the  same  proof. 

I  regard  theorem  1.1  as  the  foundation  of  semi-infinite  programming, 
possibly  for  sentimental  reasons.  In  this  paper,  I  wish  to  show  how 
other  results  may  be  derived  from  it. 

The  vector  w  in  theorem  1.1  was  described  as  an  "ascent  ray"  by 
Ken  Kortanek.   Shortly  after  I  showed  him  the  result,  he  found  the 
strengthening 


*It  is  essentially  the  result  that  any  two  norms  are  equivalent 
for  a  finite  dimensional  space. 
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Corollary  1.2:   If  there  are  no  x  such  that  a.x  >_  b.,  then  the  conclusion 
of  Theorem  1  holds  for  any  w  in  the  relative  interior  of  the  cone  gener- 
ated by  a. . 
i 

Proof:  Let  w  be  the  ascent  ray  given  by  Theorem  1*,  and  w'  be  in  the 

relative  interior  of  C(a.).   Then  for  some  finite  G  C  I,  g  >  0,  a.  >_  0 

w'  =  Bw  +  Z     a. a..   For  any  N,  there  is  a  finite  F  C  I  such  that  a.x  >  b., 
.^„  11  l—i 

i€G 

i  e  F  implies  wx  >  £(N  -  E  a .  b . ) .  Then  if  a .  x  >  b  . ,  iSFUG 

-  e   i€G  i  i        i   i 


w'x=6(wx)  +  E   a. (a.x)  _>  6(wx)  +  S  a.b.  >_  N.  Q.E.D. 

iSG  1  1  i£G  X1 

Kortanek  also  found  a  proof  of  Theorem  1.1  based  on  a  theorem 

involving  systems  of  inequalities  with  infinite  elements  [7,  10].  I  re- 
turned the  compliment  by  extending  the  infinite  element  theorem  to  cases 
involving  strict  inequalities  [3  ].   That  was  my  second  paper. 


*The  proof  of  theorem  1.1  in  [2]  uses  for  w  the  sum  of  any  set  of 


basis  vectors  for  a.. 

l 
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2.   Application  to  Semi-Infinite  Programming 

Theorem  2.1:   Suppose  there  are  x  such  that  a.x  >_  b.,  i  S  I  and  that 

every  such  x  satisfies  ex  >_ d  (i.e.,  the  semi-infinite  program  has  value 

>_  d) .  Then  there  is  a  w  and  sequences  of  finite  sets  F.  Ci  and  numbers 

N.,M.  such  that 
2     J 


(1) 


If  a.x  >  b.,  i  6  F.  then  (w  +  N.c)x  >  M.  for  j  =  1,2,... 
i-i      3  J    —  J 


(ii)   Lim  N.  =  » 

M. 
(iii)   Lim  — 1  >_  d 

Proof:   Choose  w  to  be  a  fixed  vector  in  the  relative  interior  of 

{a.}  U  {c}.   For  each  j,  there  is  no  x  such  that  a.x  >  b.  and  -ex  >  -d  +  ~r. 
i  J '  l  —  i        —      3 

By  Corollary  1.2,  there  is  a  finite  F.  C  I  such  that  a  x  >_b.  i£F, 

-Cx  >_  -d  +  —  implies  vnc  >_  j  .   By  the  duality  theorem  of  linear  programming 

there  are  a.  >  0  and  N.  >  0  such  that  E   a. a.  -  N.C  =  w,  and 

1  "        ^  *  iSF.   i  ±  j 

Z  a. a.  +  N.(-d  +  t)  >  j'.   If  we  take  M.  =JN.(d  -  — )  +  j  then  (i)  and  (iii) 
i  i    j      j  —  13  2 

are  clearly  satisfied.   (ii)  follows  because  otherwise  there  would  be 

no  x  satisfying  a.x  ^_  b . ,  i  e  I.  Q.E.D. 

The  proof  of  Theorem  2.1  in  [  2  ,  corollary  2]  was  cumbersome,  partly 
because  I  obtained  the  result  from  Theorem  1.1  rather  than  corollary  1.2. 

The  following  strengthening  is  due  to  Jeroslow  [  8 ] . 
Corollary  2.2:  Under  the  same  assumptions  as  Theorem  2.1,  there  exists 
w'  G  Rn  and  wn  such  that,  for  every  0  <  9  <  1,  there  is  a  finite  F  C  I 

such  that,  if  a.x  >  b.  i  G  F„,  then  (ew  +  c)x  >  d  -  9w  . 

i  —  it)  u 

Proof:   First  we  apply  Theorem  2.1  as  above  to  obtain  w,  N.,  M. ,  F..   We 

vv   J  3        3        1 

will  show  that  the  conclusion  of  Corollary  2.2  holds  if  we  take  w'  =  —  w, 

1 
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\  Nl 

w.  >  d  -  — .   Let  0  <  0  <  1.   Let  a.  be  such  that  a.  +  (1  -  a.)(rr-)  =  9. 
0      Nx  j  j        J  Nj 

By  (ii)  Lim  a.  =  9.   By  (i)  if  a.x  >  b.,  i  €  Fn  U  F.  then 
1  l—i       1    i 

(a.(w'  +  c)  +  (1  -  a.)(-iw'  +  c))x  =  (9w*  +  c)x  >  a .  r^-  +   (1  -  a.)^-1. 
3  J   N  —  J  Nx         j  N 

By  (ii)  and  (iii)  we  may  choose  j  so  that  the  right-hand  side  is  >_  d  -  9w  . 

Q.E.D. 
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3.      Intersections  of  Convex  Sets 

The   conditions  under  which  an   infinite   family  of  convex  sets  has 
non-empty  intersection  have  been  studied  by  many  people    [l,   4,    9]. 
The  case  of  a  family  of  closed  convex  sets  can  be  treated   immediately 
using  Theorem  1.1. 

Corollary  3.1:     Let  K. ,   i£l  be  closed  convex  sets.      If  OK.   =  0,    then 

there  is   a  w  such  that,    for  every  N,    there  is  a   finite   FCI,   and  closed 

half  spaces  H.  3  K.    such  that  wx  >  N  for  every  xe     n     H.. 
11  —  .    „     1 

ieF 

Proof :  Each  K.  may  be  represented  as  the  solution  set  of  a  system 
of  linear  inequalities  corresponding  to  supporting  hyperp lanes.   Since 
the  intersection  of  the  K.  is  empty,  the  system  formed  by  taking  all  the 
representing  systems  is  inconsistent,  and  we  may  apply  Theorem  1.1. 
The  existence  of  suitable  half  spaces  follows  from  the  duality  theorem 
for  linear  programming.  Q.E.D. 

To  study  families  of  open  convex  sets  we  make  use  of  representa- 
tions as  solutions  of  systems  of  strict  inequalities.   Hence  we  need 
to  extend  Theorem  1.1  to  systems  including  strict  inequalities. 


Lemma  3.2:  If  there  is  no  x  such  that  a.x  >  b.  iel  and 
1—1 

a.x  >  b.  ieJ,  then  for  some  ieJ  every  x  such  that  a.x  >  b.  iel  u  (J-i) 
i     i    '  J      '  1—1         J 

satisfies  -a.x  >_-b..   (hence  Theorem  2.1  and  Corollary  2.2  apply). 

Proof:  We  will  show  that,  if  there  is  an  x.  satisfying 

a.x.  >  b.  ielu(J-j)  and a.x.  >  b.  for  every  j,  then  there  is  an  x  with 
3    3  ~  1  3   3         3 

a.x  >  b.  iel  and  a.x  >  b.  ieJ.   Let  y.  ,  y_ ,  ...  be  a  countable 

1—1         1     1  71^2' 

of  the  x.  such  that  every  x.  is  a  limit  point  of  a  subsequence.   This 
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implies  a.y.  >_  b .  for  every  i  and  a.y.  >  b.  for  at  least  one  i.   Choose 

a.  >  0  so  that  So.  =  1  and  Ea.  I  ly.  I  ;  <  1  +  inf  I  ly.  I  I  .  Then  x  =  Ea.y,, 

is  defined  and  satisfies  the  desired  system.  Q.E.D. 

Theorem  3.3;  Let  V.  C  R  ,  iel,  be  open  convex  sets.   If  nv.  =  0 

then  either  (i)  the  closures  of  the  V.  have  empty  intersection  (and 

corollary  3.1  applies)  or  (ii)  there  is  a  jel,  a  halfspace  {x|cx<d}  3  V., 

weR  ,  and  w_e  R  such  that,  for  every  0  <  0  <  1,  there  is  a  finite  FCI 

and  closed  halfspaces  H.  ^  V.  such  that  (6w+c)x  >_  d-9wn  for  every  xe  n  H . . 

ieF 
The  intuitive  content  of  Theorem  3.3  is  that  there  are  three  ways 

in  which  the  V.  may  have  empty  intersection.  The  least  interesting  pos- 
sibility is  that  some  finite  subfamily  has  empty  intersection  (in  this 
case  Helly's  Theorem  implies  there  are  n+1  with  empty  intersection). 
The  second  possibility  is  that  the  V.  "march  off  to  infinity"  in  the 
manner  described  in  Corollary  3.1.   Finally  case  (ii)  describes  a  situa- 
tion in  which  the  intersection  gets  squashed  to  nothingness.   A  typical 
example  illustrating  case  (ii)  for  n  =  2  would  be  the  family 
{(x,y)|y<0}  {(x,y)||x+y>-  i}  k  =  1,2,  ... 

Proof  of  Theorem  3.3:  The  assertion  nV.  =  0  implies  that  a  system 
of  strict  inequalities  a.x  >  b.,  jeJ  has  no  solution,  where  each  inequality 
is  a  supporting  hyperplane  of  some  V..   Lemma  3.2  implies  that  one  of 
the  inequalities  is  negated  by  all  the  others.   If  case  (i)  does  not 
hold  then  the  system  consisting  of  the  others  has  a  solution  and  we 
may  apply  Corollary  2.2.   As  in  Corollary  3.1  the  appropriate  halfspaces 
may  be  obtained  by  the  duality  theorem  of  linear  programming.  Q.E.D. 


♦ 
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Corollary  3.1  and  Theorem  3.3  give  necessary  and  sufficient  condi- 
tions for  families  of  closed  or  open  convex  sets  to  have  empty  inter- 
section. We  conclude  with  an  example  illustrating  how  Theorem  3.3  may 
be  used  to  obtain  Corollary  3.1  of  [4]. 

Corollary  3.4;  Let  g:  Rn  x  T-*Ru  {<*>}    (T  compact)  be  such  that 

(a)   For  every  teT  {x|g(x,t)<0}  is  an  open  convex  set. 

(B)   For  every  t-,...t  ,,  eT  there  is  an  x  such  that  g(x,t.)  <  0 
for  all  i.   (Helly's  Theorem  then  implies  that  there  is  a  suitable  x  for 
every  finite  subset  of  T) . 

(v)   If  t.  is  a  sequence,  lim  t.=t,  H.  3  {x| g(x, t .) <0}  are  closed 


00      00 


half spaces,  and  H  C  U   D  ±s   a  closed  half space,  then  {x|g(x,t)<0}  C  H 

i=l  k=l 
(this  is  equivalent  to  a  semi -continuity  assumption  about  g) . 

Then  there  is  an  x  for  which  g(x,t)  <  0,  teT. 

Proof;  We  apply  Theorem  3.3  with  V  =  {x| g(x,t)<0} .   If  there  is 
no  suitable  x,  then  either  (i)  or  (ii)  of  Theorem  3.3  occurs. 

In  case  (i)  we  apply  Corollary  3.1  to  obtain,  for  each  N,  closed 

halfspaces  H.  D  {x|g(x,t.  )<0}  1  <_  i  <_  n  such  that  wx  >_  N  for  all  x 

n 
in  n  H.,,  (the  fact  that  at  most  n  halfspaces  are  needed  for  each  N  fol- 

i   ^ 

lows  from  a  standard  result  of  Caratheodory  [12,  2.2.11]).   If  t.  is  a 

limit  point  of  t.„,  1  <  i  <  n  then  (v)  implies  the  intersection  of  the 

IN    —   — 

n  V   is  empty,  which  contradicts  ( g) . 
i 
If  case  (ii)  occurs  there  is  a  set  with  ex  <  d  for  xeV  and,  for 

each  N,  closed  halfspaces  H   as  above  such  that  xe  n  H   implies 

V  n  V   =  <j>,  contradicting  (B).  Q.E.D. 

1 
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4.  Convex  Optimization  Application 

In  this  section  we  use  the  results  of  Section  One  to  analyze 
optimization  problems  involving  closed  convex  functions. 

Theorem  4.1:  Let  f  =  sup  {oux+gj  iel}  ;  g.  =  sup  {y..x+(5   |i£l.},  jeJ 
(here  a,  x,  yeRn).  Assume  there  is  x  for  which  g .  (x)  <_  0  and  that 
f(x)  >_ L  for  all  such  x  (i.e.,  the  convex  optimization  program  is 
feasible  and  has  value  >_  L)  .  Then  there  is  weR  such  that  for  all  e,N>0 
there  are  affine  functions  h.  <_g.  ,h<_f;8>_0;FCJ  finite;  A.  >,  0 
such  that 


(4.1)     h(x)  +  E  A.h.(x)  +  9wx  >_L  -  e  +  N8 
for  all  x. 


Proof:     The  hypothesis   implies  that  there  are  no  x  satisfying  the 
semi-infinite   system  of   inequalities   ax   <_  -   6.    +  L  -  z,    Y  —  X  <_  -   6      . 
Theorem  1.1   gives  a  w  such  that,    for  every  N,   there   is  a   finite  sub- 
system which   implies  wx  >_N.      The  duality  theorem  of   linear  programming 
implies   that   the  inequality  wx  >_  N  may  be  obtained  as  a  non-negative 
linear  combination  of  the  members  of  the   finite  subsystem.      This  means 
there  are   finite  D  C  I,    F  C  J,    F.    CI     and  r.,   s        >_  0   such  that 

(4.2)  E     r  a     +     E        E        s     y       =  -w 
i£D  jeF  ieF  J      J 

(4.3)  Er.(-6.+L-£)    +  E   E    ^(-fiy)    <  -N 
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Since  there  is  an  x  for  which  g.(x)  <_  0  we  may  assume  Er.  =  R  >  0. 
Let  8  =  1/R,  X.    =  8(Es..),  h.(x)  =  (8/X .) Es. . (y . .x+6 . . ) ,  h(x)  =  8Er . (a .x+6 .) . 
Note  that  h.  and  h  are  convex  combinations  of  affine  supporting  functions, 
hence  are  also  affine  supporting  functions.   (4.1)  may  be  obtained  by 
multiplying  (4.2)  by  -8x  and  (4.3)  by  8  and  adding.  Q.E.D. 

Theorem  4.1  in  turn  implies  a  "limiting  Lagrangian"  result  of 
Jeroslow  [ 8  ] • 

Corollary  4.2 ;  Assume  that,  in  addition  to  the  assumptions  of 
Theorem  4.1,  there  is  an  x  with  g.(x)  <_  0,  f(x)  finite.  Then  for  8 
arbitrarily  close  to  zero  there  are  X.   with 

(4.4)  h(x)  +  EA.h.(x)  +  8wx  >_  L  -  e. 

Proof:  It  suffices  to  show  that  8  approaches  zero  as  N  goes  to 
infinity  in  (4.1).  Clearly  we  have  8  <_  (N-wx)   (f(x)-L+e).   Given  two 
values  of  8,  X.    suitable  for  any  intermediate  value  of  8  may  be  obtained 

as  convex  combinations  of  the  X.    for  the  extreme  values.  Q.E.D. 

1 

We  can  also  obtain  the  Slater  point  theorem  from  Theorem  4.1. 

Corollary  4.3 :   Suppose  J  is  finite  and  there  is  an  x   with  g.(x)  <  0, 
f(x)  finite.  Then  there  are  X.   with 

(4.5)  f(x)  +  EX.g.(x)  >_L 
for  all  x. 


Proof:   For  N  >  wx  (4.1)  implies  X.    <_  (-1/g .  (x) )  (f  (x)  -  L  +  e) . 
As  e  approaches  zero,  compactness  implies  the  have  a  limit  point  which 
satisfies  (4.5)  Q.E.D. 
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Uzawa,  and  more  recently,  Duffin  [5],  have  shown  that  in  the  case 
in  which  some  of  the  constraints  are  affine  the  Slater  point  need  only 
be  strict  for  the  nonaffine  constraints.  We  establish  a  finite- 
dimensional  version  of  this  result. 

Corollary  4.4;  Suppose  J  is  finite  and  that  ||ct.||,  |S.|, 
|  | Y -  - | | »  1 5.. I  <_ M  for  all  i,  j  (this  is  equivalent  to  assuming  the 
functions  are  continuous).   If  there  are  x,  6  for  which  g.(x)  <_  0 
and  y .  ,x   +  <5 .  .  _<  B  <  0  for  all  but  finitely  many  (i,j)  then  there  are 
X.    for  which  (4.4)  holds. 

Proof:  We  repeat  the  proof  of  Theorem  4.1,  showing  that  for  large 
N  and  small  e  the  values  of  the  X .  stay  bounded.   Then  a  compactness 
argument  as  in  Corollary  4.3  completes  the  proof. 

From  (4.1)  to  (4.2)  we  obtain 


(4.6)     (L-F)-h(x)  +  9ZZ-s..(y. .x+5. .)  <  6(wx-N) 

i]  i]   ij  — 

for  all  x.   When  N  >  wx  this  implies  9s..  <  — (L-f(x)-e)  for  all  but 

—  ij  —  p     — 

finitely  many  s , . .   Further,  only  n  s..  can  be  nonzero  by  Caratheodory 's 
lemma.   To  establish  bounds  on  the  remaining  9s. .  we  use  the  facts  that  9 
approaches  zero  for  N  large  (see  corollary  4.2)  and  that  the  optimal 
solution  to  a  linear  program  may  be  assumed  to  be  in  a  bounded  region 
when  the  right  hand  side  varies  through  a  bounded  region.   These  results 

establish  bounds  on  A  . . 

J 


-11- 

5 .  What  About  Systems  With  Infinitely  Many  Variables? 

I  consider  semi- infinite  programming  a  nearly  complete  theory,  but 
there  are  interesting  questions  lurking  on  the  boundary  between  semi- 
infinite  programming  and  infinite  systems. 

One  way  to  consider  such  problems  is  via  functional  analysis.  A 
representative  result  is  a  corollary  of  a  theorem  of  Hahn  [ 6  ,  p.  86]. 

Theorem  5.1:   If  X  is  a  reflexive  Banach  space  and  a.  are  contin- 
uous linear  functionals,  the  system  of  inequalities  a.x  ^_b.,  iel  has  no 
solution  if  and  only  if,  for  every  N,  there  is  a  finite  F  C  I  and  a 
functional  w  with  |  |w  |  |  <_  1  such  that  vr^x.  >_  N  for  all  x  such  that 

a.x  >  b.,  ieF. 

2 
When  X  is  1  ,  Theorem  5.1  gives  a  condition  under  which  a  system 

with  countably  many  variables  has  a  solution  with  the  sum  of  squares 
converging.  Early  work  of  this  type  is  reported  in  Chapter  3  of  the 
still  interesting  [11]. 

It  is  easy  to  see  that  Theorem  1.1  does  not  generalize  to  the  con- 
text of  Theorem  5.1.  We  cannot  have  w  the  same  for  all  N.  A  simple 

2 
example  is  to  take  a.  an  orthonormal  basis  for  I     and  b.  go  to  in- 

finity. 

If  one  is  interested  in  solutions  to  infinite  systems  which  are 

2 
not  in  I     some  restriction  is  necessary  on  the  type  of  inequalities 

allowed.  A  natural  restriction  is  that  each  of  the  inequalities  involve 

only  finitely  many  variables.  Morley  has  announced  a  result  of  this 

type.   It  claims  that,  if  a  system  is  inconsistent,  then  the  system  is 

equivalent  to  a  canonical  inconsistent  system,  in  the  sense  that  each 

inequality  of  the  canonical  system  is  implied  by  finitely  many 
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inequalities  of  the  original  system.   In  Morley's  result  the  canonical 

system  has  uncountably  many  inequities. 

We  outline  a  possible  analysis  based  on  countable  systems.  Let 

(S)  be  an  inconsistent  system.  An  FV  subsystem  is  a  subsystem  of  (S) 

involving  only  finitely  many  variables.  Define  an  ordinal-valued  rank 

for  (S)  as  follows:   (S)  has  rank  zero  iff  (S)  contains  an  inconsistent 

FV  subsystem  (Theorem  1.1  characterizes  such  subsystems).   (S)  has  rank 

a  if  (S)  has  no  smaller  rank  and  there  is  a  sequence  of  inequalities 

a.x  >_  b.  of  rank  zero  such  that  for  any  i  and  any  e  >  0  the  system 

(S)  U  {-a.x  >  -b.  +  e}  is  an  inconsistent  system  of  rank  <  a. 
i  —   x 

I  conjecture  that  for  every  countable  ordinal  a,  there  are  systems 
of  rank  a  and  (less  confidently)  that  every  inconsistent  (S)  has  a 
countable  ordinal  rank. 

Finally,  we  wish  to  give  an  example  indicating  the  difficulties 

that  confront  any  attempt  to  allow  infinitely  many  variables  in  each 

inequality.  Consider  a  system  involving  the  variables  xs  for  every 

S  c  [0,1]  as  follows:   each  variable  is  between  zero  and  one, 

xr^  . -,  =  1,  xr  ,  =  0  for  all  r,  and  if  the  sets  S.  are  disjoint  and 
[0,1]       {r}  i 

T  =US.  then  -x_  +  Zx   =0.   This  system  has  a  solution  if  and  only  if 

there  is  a  countably  additive  measure  defined  on  all  subsets  of  the  reals. 
Banach  and  Kuratowski  proved  this  system  is  inconsistent  assuming  the 
continuum  hypothesis.  Later  work  indicates  that  some  special  axiom  is 
needed  to  prove  this  system  has  no  solutions. 
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